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This analysis of 1,200 educational research and 
development projects taken from the U.S. Office of Education's 
"Current Project Besumes, July 1970" was made to determine the 
crucial objectives or activities which have a direct effect on 
project costs, as part of the planning for the National Institute of 
Education. Projects were categorized according to the kind of output: 
theoretical, analytical, and experimental studies; surveys; 
evaluations; developmental projects; training programs in educational 
research; conferences, workshops, and symposiums; and research and 
development centers and regional laboratories. Categories were 
divided into subgroups according to project cost and were 
subsequently analyzed for common cost-differentiating 
characteristics~.~~Flow~charts ~using"sequen^t 

developed for sorting the projects into their apF^copriate cost 
groups. Eight percent of the projects studied did not fit the 
classification scheme; that is, they were sorted into one group on 
the basis of their cost and into a different group on the basis of 
their descriptive characteristics. The classification scheme is 
limited by the accuracy of the data reported in the project resumes 
with regard to a) adequacy of funding level, b) quality of 
investigator or project outcome, and c) amount of supplementary 
funding from sources other than the Office of Education. (HMD) 
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PREFACE 



In the spring of 1971, the Commissioner of Education's 
Planning Unit for the proposed National Institute of Education 
asked Rand to prepare an analysis on alternative management methods 
and procedures for conducting research and development. The project 
was also to include a series of cost models descriptive of past 
educational R&D projects and useful for the planning of new R&D 
programs by the proposed institute^ This working note is directed 
toward the latter task. 

Dependence on a limited data base of Office of Education funded 
R&D projects led to the development of cost models in the form of 
heuristic riiles, or general rules of thumb, rather than in the form 
of quantitative formulations. These cost rules provide the basis 
for placing any educational R&D project, according to its major 
objectives and component activities, into a specified cost range. 
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I . INTRODUCTION 



Guidelines to the costs of prospective R&D projects, both 
individually and aggregated to major educational programs, are 
valuable tools for educational planners. Given an estimated 
future budget, planners may use these guidelines to determine how 
many of the various kinds of R&D activity may be afforded. Conversely, 
given a desired package of specified R&D projects, planners may use 
the guidelines to estimate the associated costs of tke package. 

Any guidelines that may currently exist are in the form of 
general heuristics, or rules of thumb. For example, a heuristic 
may be that development projects cost about ten times more than 
analytical studies, or that educational R&D projects which involve more 
than ten man-years effort cost disproportionately more than 
projects utilizing less effort. Unfortunately, almost no 
validated general rules such as the above are well known or 

- - documented. Educational, cost-estimators may use their _qwn 

implicit rules of thumb in approving cost estimates of various 
R&D projects, but a validated Handbook of genaral cost-estimating 
principles is not yet developed, despite the great value that such 
a Handbook would provide. 

This paper is the first step toward such a Handbook. It is 
an analysis of a large set of actual educational R&D projects for 
the purpose of determining what are the crucial objectives or 
project activities which tend to make projects cost what they do. 

IN PUT VERSUS OUTPUT ORIENTED COST MODELS 

Cost models which are directed toward the input side of R&D 
projects merely redescribe the project costs and add no new in- 
formation concerning the reasons why the stated amount of 
resources are required. Unfortunately, many cost models are 
exactly of this type. Given a set of input variables such as the 

ERLC 
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number of man-years required, they provide the proper cost factors 
to use in calculating the total project cost. But why is that 
particular amount of man^years required in the first place? 

In contrast, an outp-ut oriented cost model focuses on ^/hat the 
project is trying to do, its objectives and proposed activities, 
as guides to what the project will coat. The assumption, for 
example, is that projects which are surveys are basically different 
from projects which are research training programs or projects which 
involve curriculum development, and should reqxiire different costs 
for different reasons. 

The analysis for such an output oriented cost model requires 
two kinds of data: the cost of projects and some kind of description 
of their objectives and activities. Objectives in the forms of 
"improving education," or "adding to the knowledge of learning 
disabilities" give little indication of raasons underlying project 
costs. More informative objectives are: developing materials for 
new curricula, conducting a literature review or controlled 

experiment, survey ing._a_selec.ted.populatio 

istics, or running a national conference for a five day period. 
Additional cost related information is provided by statements of 
the actual activities that will be conducted in pursuit of these 
objectives: surveying by interview to three hundred people or by 
questionnaire to three thousand people, experimenting for which new 
equipment need by designed and tested, and developing materials and 
including teacher training in their use, evaluation of their effects, 
and dissemination of their results. 

The inclusion of certain of these kinds of activities may 
provide an indication of relatively higher cost. But since the cost 
figure provided is usually either total project cost or cost break- 
down into functional components such as salary and travel, it is impos- 
sible to tell how much of the total project cost is directed specifically 
toward evaluation, training, or other activities. Consequently , an 
analysis of the data may show that development projects which include 



evaluations may cost more than development projects which do not, but 
it cannot show how much evaluations for developnvent projects cost. 
This is true because many different kinds of things are being developed 
and some projects include other kinds of activity, such as training, as 
well. 

The key to any output oriented cost model is classification, 
where classes are based on characteristics which seem to effect the 
cost of the project. The analysis required for such a classification 
is simply a systematic search for those characteristics. This paper 
presents (1) the preliminary results of such a search, (2) the 
resulting classification of educational R&D projects into cost groups 
on the basis of such a classification, and (3) for each project cate- 
gory, a simple flow chart of questions or characteristics which can 
be used to sort any educational R&D project into its cost group. 

THE DATA BASE 

The entire set of projects used in this analysis was taken 
from the Office of Education's Current Project Resumes, July 1970 . 
Over twelve hundred project" des crip tions con tained in- this report 
were individually studied and used in the development of the classi- 
fication scheme, until all the projects contained in the report were 
sorted into their appropriate classes. 

The resulting analysis and classification scheme Is limited 
both by the accuracy of the cost figures provided in the report 
and by the descriptive quality of the project resumes. Of the 
twelve hundred fifteen project descriptions used, only fifty-seven 
were either distinctively unique, or insufficiently informative 
concerning the reasons for cost magnitude to be included in the 
project categories. Limitations on the accuracy of costs focus on 
three Issues: (1) Adequacy : No indications are provided by the data 
that projects were neither over funded nor underfunded with respect 
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to meeting their project objectives. (2) Quality : No indications 
are provided by the data regarding the level of quality of either 
investigator or project outcome. (3) Joint Funding s No indications 
are provided by the data of supplementary funding by other agencies, 
though instances of this situation are probably few. 

ORGANIZATION OF THE PAPER 

The paper is divided into nine main sections, according to the 
division of R&D projects into categories on the basis of objectives 
and activities. Each section contains three parts: 

1. A list of the descriptive characteristics , and their 
operational definitions specific to the project cate- 
gory. These are used to sort projects Into the 
various cost groups. 

2. A list of the cost groups for the category, and the 
associated descriptive characteristics which are common 
to each group. 

3. A flow chart for costing projects of the category, - 
consisting of the systematic sorting of projects into 
their cost group on the basis of descriptive charac- 
teristics. 

Descriptive Characteristics 

These are the bases for sorting projects Into cost groups. 
They may refer to scale : number of Interviews, number of partici- 
pants, length of program J size of added staff; inclusion of activities : 
evaluation included, teacher training included, design of equipment 
Included; scope of objective : overall evaluation, or impact on one 
or two specified variables; development of materials for a total 
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curriculum, or for only one course; methodology : laboratory ..experi- 
mentation, or literature search; questionnaire, or interview; focus : - 
organizational efficiency, or classroom conduct; development of 
subject content, or of testing procedures; program planning, or 
demonstration and dissemination; adding staff, or adding space and 
equipment; and type : seminar, or conference; ERIC center, or 
regional lab; training institute, or Ph.D. program; high school 
course, or college course; project evaluation, or program evaluation. 

Cost Groups 

Cost groups vary in nuniber of groups and cost spans, across 
project categories. The number of groups reflects the cost dis- 
criminating powers of the descriptive characteristics; more groups 
indicating a greater ability to explain cost differences in terms 
of the characteristics. Some cost groups contain specific spans; 
e.g., $10,000 to $50,000, while other groups merely identify general 
level; e.g., over $1,000,000. 

Associated with e ach cost group is a lis t of the descriptive 
characteristics which are common to that group, and the number of 
projects found which fall within the cost span. 

Flow Charts 

The flow charts are a more useful way of presenting the infor- 
mation provided in the cost groups. By sequentially asking questions 
concerning the descriptive characteristics of the projects, these 
charts sort the projects into their appropriate cost group, indicated 
on the flow chart in thousands of dollars. Additional data is pro- 
vided concerning how many projects of the data base are sorted into the 
cost groups for the stated reasons > the average project cost within 
that cost group. 

For example, part of the flo(w chart for costing projects of^ the 
category: Theoretical, Analytical, and Experimental Studies, 
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Is reproduced below: 




WHICH METHODOLOGY? 



LABORATORY 
EXPERIMENTATION 



DESIGN AND TEST NEW EQUIPMENT? 




NO 


^ YES: 








LONGITUDINAL? 





50-150 (9) 103 Av. 



A project which is placed in the category of Theoretical, Analytical, 
and Experimental Studies, and which uses laboratory experimentation 
as its methodology, which involves n£ design and testing of new 
equipment, and which is longitudinal, falls into the $50,000 to 



$150,000 cost group . Furthermore, this classification is based on 
9 different pro^jects found in the data base which both display these 
same character is tics-^and which cost between $50,000 and $150,000. 

One distinctive feature of these flowcliarts is the importance 
of the order of discriminating questions. All projects are sorted 
into the first cost group possible. For example. In the above case, 
projects which include the design and test of new equipment fall 
into the $150,000 to $500>000 cost group whether they are longitudinal 
or not. In terms of sorting, earlier questions always take precedence 
over later ones. 

Organization of data for the development of these flow charts is 
facilitated by using data matrices such as those listed in the 
Appendix for each R&D category. Individual projects are described 
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by a single column in this appropriate matrix. Down the left-hand 
side of the matrix are the descriptive characteristics used to sort 
projects into cost groups, "X"s or nusibers within the matrix 
Indicate satisfaction of the characteristic by the appropriate 
project. The bottom row of the matrix provides space for project 
costs. 

LIMITATIONS OF THE COST MODEL 

Two kinds of limitations must be recognized: (1) limitations 
of the model based on the non-complete nature of the data, and 
(2) limitations of the rules and characteristics used to sort 
projects into cost groups. The first kind refers to \jise of the 
model for costing a new project composed of a set of character- 
istics unlike any encountered in the data base. The second refers 
to the rule violators, projects which are sorted into one cost 
group on the basis of their descriptive characteristics and into 
another on the basis of" their costT " 

Rule violators are indicated in the sections of cost groups 
for each R&D category, but are not represented in the flow 
charts. Only fifty-four or approximately eight per cent of all 
projects sorted into cost groups on the basis of descriptive 
characteristics were rule violators. 

The first limitation, and the more Important, emphasizes the 
non-universality of the cost model. Projects containing new 
combinations of characteristics may fall into none of the cost 
groups by application of the flow chart. For example. Included in 
the data base are su:rveys of approximately 1600 interviews and 
surveys of approximately 4000 interviews. Whether a new project 
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conslstlng of 3000 Intervlewtf would fall Into one cost group or 
the other cannot be determiaec? on the basis of the data which was 
ttsed to develop the model. Quantitative interpolation or extrapo'- 
lation may be valid in some cases such as surveys, but is not 
readily applicable in other more qualitative cases of project 
differences* 

This limitation stresses the nature of the paper as providing 
guidelines , rather than answers. "Interpretive interpolation" 
will usually be required for any new projcect costing. However, 
these guidelines may be a useful way to provide a baseline cost 
for new projects from which adjustments may be made on the bases 
of individual variation from projects within the data base. 

KEEPING THE MODEL UPDATED 

The non-complete nature of the flow charts and the existence 
of rule violators emphasize the cost model as being a product of 
selectivity and Interpretation. Furthermore, as experience with 
R&D programs and methodology grows, what requires a certain amount 
of resources at one time may require a different amount at 
another. In other words, what was once a cost discriminating 
characteristic of projects at one time may lose its discriminating 
powers as changes in R&D occur. Consequently, new cost dis- 
criminators must be found and new flow charts written for effec- 
tive guidelines. 

Additionally, as new projects are added to the data base, 
subsequent analyses may select a different and more discriminating 
set of project descriptors as the bases of cost estimating guidelines 
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Revislng the model on the basis of new data req;utres going through 
the same procedure as formulating the first model. This procedure 
is detailed in the following eight steps. 
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STEPS IN DEVELOPING OUTPUT-ORIENTED POST MODELS FOR EDUCATIONAL R&D PROJECTS 

Step 1> (Output Categories) 

Divide the total set of projects into separate categories on the 
basis of kinds of output or producte produced^ or kinds of activities 
performed* 

e.g. (1) Theoretical , analytical and experimental studies 

focusing on: ' 

literature review, analysis, experimentation, 
explanation. 

(2) Surveys 

focusing on: 

attitude, opinion, characteristic or decision 
descriptors or a selected population. 

(3) Program or product evaluations 

focusing on: 

assessment or impact on a selected population 
by a specified program or product. 

(4) Developmental projects 

focusing on: 

construction of materials, curricula, 
measuring scales, techniques, or class- 
room or administrative procedures. 

(5) Research training programs 

focusing on: 

structured training experiences in research 
for selected populations. - 

(6) Conferences, symposiu6ia, and seinihars 

focusing on: 

planned and structured forums for discussion 
and dissemination of preselected topics 
and ideas. 

( 7) Establishment (or continuation) of canters or 

national and regional laboratories 
focusing on: 

coordination of multiple, continual efforts 
toward an overall objective or in a specified 
area. 

(8) Program or fmctlon facilitation projects 

focusing on: 

augmenting existing activities by providing 
either facilities expansion, services, teacher 
or leadership training, demonstration or dis- 
T-T)^^ semination activity, additional pilot program 

fcjv^ testing, or program planning and development. 
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figure !• (cont*) 



(9) [R esidual category ] 

all projects ^$10,000. 



Step 2. (Category Cost Lists) 

For each category, excluding residual, list the project costs in 
increasing order. 

S tep 3* (Cost Groups) 

Look for naturaJ divisions in the cost lists; e.y.j dividing 
project costs into subgroups of: 



S tep 4, (Project Characteristic List) 

Using the project descriptions, develop a first-cut list of 
''yhaz*aoteristics which describe the projects in terms of 

a) focus 

b) level (preschool, elementary, high, college or post-high) 

c) methodology 

and other appropriate traits which may affect cost, and produce 
for each cost group a matrix of all projects described in terms 
of these characteristics. (See the Appendix for descriptions of the 
actual matrices used to develop this Report.) 

Step 5. (Cost-Differentiating Characteristics) 

Using both the matrix and the original project descriptions, try 
to determine what it is that maJces projects in one cost group 
different from those in other cost groups. 



e.g.y In the category of the theoretical, analytical, and 
experimental studies, of those projects which employ labora- 
tory methodologies, the projects which do not include designing 
and testing of new equipment tend to fall into the $10,000 - 
$50,000 cost group > while those projects which do include 
designing and testing of new equipment tend to fall into the 
$150,000-$500,000 cost group. 



Step 6. (Revision of List of Differentiating^ Characteristics) 

Continue to revise and search for dif ferr^ntiating characteristics 
so that each project in the output category can be assigned to 
either a single cost group or to a re«idual group In which project 
descriptions are too general to identify cost differentiators. 



$10,000 
$50,000 
$150,000 
$500,000 



$50,000 projects 
$150,000 projects 
$500,000 projects 



$1 M projects 



figure 1. (cont.) 



Step 1. (Cost Group Sxnnmarles) 

For each cost group in each output category, siimmarize the 
differentiating characteristics pertinent to it. 

Step 8. (Project Sorter) 

Construct a project-sorting flow chart for each output category 
which will sequentially apply questions referring to differentiating 
characteristics and thus sort projects into their cofit group. 
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II, TtlEORETICAL, ANALYTICAL AND EXPERIMENTAL STUDIES 

(A) Descriptive Characteristics: 

1. Laboratory Experimeatatton , Emphasizes the application of 
controlled treatments, or division of subjects among groups 

by specified natural characteristics, for purposes of measuring 
treatment effect. 

"Laboratory" may mean room, course, school, or 

program setting. 

2. Literature Search/Data Analy;sis , Emphasizes the analysis of 
material or data which has already been produced rather than 
the collection of new material. 

3. Interviewing . Emphasizes collection of new data primarily 
by interview, structured or unstructured. Studies based 
solely on administration of questionnaires are not included, nor 
are general surveys unconcerned directly with explanation. 

4. Design and Test /Equipment . Included in the study is the 
development and test of new hardware for purposes of 
experimentation. 

5. Design and Test /Measures . Included in the study is the 
development and test of new measuring scales or models of 
measurement, or measuring tests. 

6. Automatic Data Processing . At least part of the analysis to 
be performed will be done by computer. 

7. National/ Int r ^mational Data Base * The data base to be analyzed 
is to be collected from throughout the United States or among 
more than one country. 

8. Supplementary New System Design . Included in the study are 
major efforts toward either system improvement or design of 
new systems . 

9. Small Scale Interviewing . ^1000 interviews. 

10. Large Scale Interviewing . >1000 interviews. 

11. Administration of Existing Tests , Included in the study is 
the administration of existing tests— of one or more standard- 
ized tests, psychological or physicological. 

12. Longitudinal . The application of treatment, data base, or 
interviewing process extends throughout a program, course of 

^ study, or a year or more. 

ERIC 



Cost Groups: 



A. $10,OQO-$50,OQO Coat Group ; (92) 

1. Using labratory experimentation (32) 

a. nonlongltudinal, and 

b. for which no new equipment or measuring Scales 
are designed and tested. 

Primary focus is on perceptual motor skills and learning 
procedures. 

2. Using literature search and/or Data analysis (48) 

a. involving no automatic data processing 

b. no nationwide data base, and 

c. ^no accompanying efforts toward system redesign or 

improvements . 

3. Using very small scale interviewing (a few hundred or less). 

4. Rule violators. (4) 

B. $50>000-$150,000 Cost Group ; (57) 

1. Using laboratory experimentation (20) 

a. for which no fiew equipment is designed and tested, and 

b. involving either 

(1) designing and testing new measuring scales or 
tests 

(2) longitudinal application of treatment. 

2. Using' literature search and/or data analysis including (26) 

a. only automatic data processing, or ■ 

b. only a national data base, or 

c. only supplementary efforts toward system design 
or imporvements, or 

d. only supplementary interviewing. 
Primary focus is on organization efficiency. 

3. Rule violators (11) 

C. $150,00-$500,00 Cost Group; (29) 

1. Using laboratory experimentation for which new equipment 
is designed and tested. (3) 

Primary focus is on perceptural -motor skills and lea'ming 
procedures. 

2. Using literature search and/or data analysis (14) 

in which supplementary new system design or 
improvement is combined with either 

a. automatic data processing, or t 

b. national data base, or ! 

c. supplementary interviewing. 



Using interviewing: (5) 

either a. longitudinally, or 

b. large samples ( >10QQ) , 



Rule violators (7) 
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figure 2. 

FLOW CHART FOR COSTING 
•mEORETICAL. ANALYTICA L AND EXPE RIM ENTAL STUDIES ^78) 



LABORATORY 
EXPERIMENTATION 




WHICH METHODOLOGY? 



(69) 



> 



( DESIGN & TEST/NEW EQUIP? ) 

L 

L*. YES: 



YES: 150-500 (3) 261 Av. 



NO 



C LONGITUDINAL? ) 

tvES: 50-150 (9) 103 Av. 



C 



NO 



DESIGN & TEST/NEW^ MEASURING S GALES/ TESTsTQ 



NO: 



YES: 50-150 (11) 85 Av. 
10-50 (32) 32 Av. 



LITERATURE SEARCH AND/OR 
DATA ANALYSIS 



(95) 



DESIGN OR NEW SYSTEM OR IMPROVEMENTS 

PLUS EITHER EDP, NATION AL DATA BASE, OR INTERVIEWS 



"YES: 15C-50C vl4) 339 Av. 



NO 



( ANY OF THE ABOVE?) 

I L^YES: 50-150 (26) 107 Av. 

InO:-^10-50 (48) 30 Av. 





1^ 


INTERVIEWING 


(14) 



I LONGITUDINAL'^ 


^YES: 150-500 (4) 271 Av. 

[no 

i LARGE SCALS~"(>1000)? 



YEG: 150-500 (1) 489 Av. 
l-N0:-*'10-50 (8) 27 Av. 
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Nunber In () » number of projects which fell Into that cost group or 
category* Cost groups stated in thousands of dollars. Rule violators 
are not represented. 
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III. SURVEYS 



(A) Descriptive Characteristics: 

1. Very Small Scale , 

Less than 300 interviews, or 
less than 3000 questionnaires, or 
3 countries surveyed. 

2. Small Scale . 

1600 interviews, or 
8000 questionnaires. 

3. Medium Scale . 

4000 Interviews, or 
12,000 questionnaires, or 
6 countries surveyed. 

4. Large Scale . 

9000 interviews, or 
19 countries surveyed. 

5. Very Large Scale . 

130,000 interviews. 

6. Supplementary New System Design . 

Included in the study are efforts toward either system 
improvements or development of models. 



(B) Cost Groups: 

A. $10,000-$5Q,000 Cost Group : (6) 

1» Very small scale 

2. No longitudinal data collection 

3. No dissemination efforts 

4. No supplementary new system design 

B. $50,000-$150,000 Cost Group : (6) 
Small scale 

Some dissemination efforts 
Efforts toward system or model design 



1, 
2, 

or 3. 
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C. $150,000-$500,000 Cost Group : (9) 

1. Medlm scale 

2, Major efforts toward system or model design 

D. Large and Very Large Cost Group ; (3) 

1. Large scale ($782,000, $1,069,000) 

2. Very large scale ($8,272,000) 
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a.OW CHART FOR COSTING SURVEYS (24) 



(5> 



< 



APPROXIMATE SIZE OF SAMPLE TO BE SURVEYED? 



<300 INTERVIEWS 
OR <3000 QUESTIONNAIRES 
OR 3 COUNTRIES 



NO 



T 



►YES: 10-50 (*) 22 Av. 



@ [ 
( 



1 



UNKNOWN SIZE OF SAMPLE 



' 1600 INTERVIEWS 
OR 8000 QUESTIONNAIRES 

~ rz 



YES: 50-150 (2) 95 Av. 



NO 



± 



4000 INTERVIEWS 
OR 12 ,000 QUESTIONNAIRES 
OR 6 COUNTRIES 



♦.YES: 150-500 (4) 270 Av. 



NO 



9000 INTERVIEWS 
OR 19 COUNTRIES 



i ^YES: 500- 1 M (2) 926 Av. 



NO I 



130,000 INTERVIEWS 



-YES: 8 M (1) 8,272 



I 



MAJOR EFFORTS TOWARD 
MODEL OR SYSTEM DESICai? 



NO 



YES: 150-500 (5) 352 Av. 



SOME EFFORTS TOWARD MODEL OR 
SYSTEM DESIGN, OR DISSEMINATION 
OF SYSTEM RESULTS? 



NO 



-♦-YES: 50-150 (4)101 Av. 



10-50 (2) 33 Av. 



Number in () = numtoer of projects which fell into that cost group or 
category. Cost groups stated in thousands of dollars (or M = millions 
of dollars). Rule violators are not represented. 
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IV, PROGRAM OR PRODUCT EVALUATIONS 



(A) Descriptive C3iaracterlsltcs: 

1, Small Scale , 

300 interviews 
2000 questionnarles 

2, Large Scale , 

30,000-35,000 questionnaires 

3, Few Variables Only , 

Evaluation Is directed toward specified few measures 
such as cost, difference in student achievement, 
acceptability. 

4, Overall Evaluation , 

Complete assessment of the program or product, 

5 , Developments for Improvement , 

Inclusion of new system design, pilot versions of 
new programs or products, or recommendations for 
improvement , 

(B) Cost Groups: 

A, $10,000-$50,000 Cost Group : (8) 

1, Examination of effect on a lew variables only using either 

(a) laboratory experimentation or 

(b) analysis of existing data, (4) 

or 2, Overall evaluation of program or product by small scale 
evaluation efforts, (4) 

3, In all cases: no developments for improvement,. 

B, $50,0 00- $150,000 Cost Group : (15) 

1. Overall evaluation by methods including analysis 
cf existing data. (12) 

2. In all cases: no developments for improvement, 

3. Rule violators (3) 

C, $150,000'-$500,00 Cost Group : (10) 

1, Overall evaluation of program or product by large 
scale evaluation efforts, (2) 
or 2. Inclusion of developments for improvement, (6) 
3. Rule violators (2) 
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fi gure 4. 



FLOW CHART FOR COSTING PROGRAM OR PRODUa EVALUATIONS 



(33) 



YES 



OVERALL EVALUATION RATHER THAN EFFECT 
ON A FEW VARIABLES? 



NO 



LARGE SCALE: 

30,000-35,000 

QUESTIONNAIRES? 



NO 



DEVELOPMENTS FOR 
IMPROVEMENT OF 
PROGRAM OR PRODUCT? 



NO 



T 



50-150 (12) 99 Av. 



■♦- NO: 10-50 (4) 35 Av. 



SMALL SCALE: 

300 INTERVIEWS OR 

2000 QUESTIONNAIRES? 



■♦•YES: 10-50 (4) 33 Av. 



■-YES: 150-500 (2) 207 Av. 



■♦-YES: 150-500 (6) 221 Av. 



ERIC 



Number in () = ntiihber of projects which fell into that cost group or 
category. Cost groups stated in thousands of dollars. Rule violators 
are not represented. 
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V. DEVELOPMENT PROJE CTS FOR CUR RI CULA OR MATERI ALS 

(A) Development Categories: 

Development projects include such a wide variety of activity that 
it is first necessary to separate the total set of projects into 
sub-objective categories before searching fur cost differentiating 
characteristics, (lliis separates the apples from the oranges before 
examining size as a lunction of fertilizers.) In this study, develop- 
ment projects are classiiLed according to the following sub-objectives: 



Development Categori es 
I. Subject Mat te r (Content) Only . 

A. Materials only, e.g., texts, films 

B. Curriiula for a single course 

C. Curriciila tor a single field, e.g., mathematics or social studies 

D. Total curriculum, e.g., entire high school curri.:uliim 

II . Classro om Operations (Pedagogy or Te s ting) Only 
III. Subject Matt er P l us Classroom Oper ations 

A. For a single course 

B. For a single field 

C. For a total curriculum 

IV. Administrative Techniques/Procedures 

A. With computerized systems 

B. Without computerized systems 



(B) Descriptive Characteristics: 

1. Subject Ma t ter O uLy 

Directed toward the development of 'mteriala or o-urricula to 
be used by students in the classroom. These projects are 
oriented toward content only. 

2. Classroom Operations Only. 

Directed toward the development of teaching teiszing prooedures 
or techniques, cooperative olassroom ar^^^angements ^ or materials 
for either, which affect the teacher-student interaction. These 
projects art^ oriented primarily toward the teaching process. 
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3. Subject Matter Plus Classroom Operations 

Directed toward the development of both materials of 
content and procedures or arrangements for classroom 
operations . 

4 . Administrative Techniques or Procedures , 

Directed toward the development of analytic tools or 
procedures for school management or organization, or 
for student counseling. 

5. Materials Only 

Including textbooks, workbooks, manuals, TV shows, films, 
audio tapes, displays, games, computer programs, laboratory 
equipment, and analytical or simulation models. 

6. Curricula for a Single Cour se. 

Projects directed toward the development of a single 
specified course, whether oae semester or one year. 

7. Curricula for a Single Field o. Course of Study . 

Projects directed toward the development of a single 
field of knowledge such as physics, matbamatics, electrical 
engineering, agricultural vocation, and involving more than 
one course. 

8. Total Curricula . 

Projects directed toward the development of an entire 
curriculum covering all relevant fields. 

9 . Evaluation Included . 

Projects which include stated efforts toward the evaluation 
of materials, curricula, or procedures developed. 

10. Training Included . 

Projects which include stated efforts toward the training 
of teachers or equipment users in the application of the 
the product or procedure developed. 

11. Dissemination Effort Included. 



Projects which include stated efforts toward dissemination 
of project results. 
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12 . Surveys /Conferences , 

Projects which include planned seminars, workshops, or conferences 
as part of th^ development activity, or which include interview 
or other survey techniques for planning or evaluation. 



13. Generalized. 



Development projects purposely directed toward widespread or 
general application* 

14. Targeted. 

Projects which are directed toward only one or ^ few schools, 
distrl cts , organizations , or appl icat ions . 

( C) C ost Groups f or the Different Categor ies . 

Category D ata Pages 



A 


Subject Matter - Materials 


1-2 


B 


Subject Matter - Single Course 


3 


C 


Subject Matter - Single Field 




D 


Subject Matter - Tot^l Curriculum 


b 


£ 


Classroom Operations 


7 


F 


S.M. Plus - Sip^?le Course 


8 


G 


S.M. Pius CO. - sliKxe Field 


9-11 


U 


S.M. Plus CO. - Total Curriculuir 


12-14 


I 


Adm. Tech/Proc. * Vlf^» Computer System 


15 


J 


Adm. Tech./Proci • Without Computer System 


16-18 



Category A: Su bject Ma tter - Materials Onljr (16) 

$10,000 - $100.000 Cost Group ! (8) 

1. Projei'ts targeted toward one or a few schools 
or 2. Generaliz*^d pro^erts which do not include development 
of any manuals or guides 
3. In aiJ cases: Nc training, textbooks, workbooks, 
films, or ci»tnDutHr programs/systems 

$1 00,00 0 - $200,000 0;s Gro.i£: ( 4) 

1. (Generalized projects, including the development of 
manuals, texts , or films and audio presentations 
* 2. In all '.-a^t's: No evaluation, training, or dissemination 
ef torts are included in the project statement 
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$200,000 - $500,000 Cost Group : (3) 

1. Generalized projects which do include evaluation 
or trciining in their statement 

2. Projects including the development of: films and 
audio presentations, or computer systems and associated 
manuals /guides, or texts. 

$ Larger ($550,000) : (1) 

1. Generalized projects which include the development 
of a combination text and computer system 

Category B: Subject Matter - Single Course : (6) 

$10,000 - $100,000 Cost Group : (4) 

1. Generalized projects which include either evaluation, 
or the development of films and audio presentations 

2. In all cases: No dissemination, or training 

3. In all cases: At the elementary or college level 

$160,000 - $260,000 Cost Group : (2) 

1. Generalized projects involving the development of a 
combination of test instrument, audio presentation, 

workbook, and manual, 
or 2. Generalized projects including the development and 
dissemination of a textbook. 
3. In all cases: At the high school level 

C ategory C: S u bject Matter - Single Field : (18) 

$60,000 - $100,000 Cost Group : (3) 

1. Generalized projects including no evaluation, training, 
dissemination, or surveys /conferences 

2. In all cases: At the elementary or high school level. 

$100,000 - $200,000 Cost Group : (5) 

1. Manuals /Guides for targeted efforts only 

2. Evaluation or surveys/ conferences included 

3. At any of the school levels 

$200,000 - $400,000 Cost Group : (7) 

1. All generalized projects at the elemerttary or high 
school levels. 

2. Including evaluation and/or manuals / guides ; some pro- 
jects include teacher training, dissemination, and 

s urveys/ conferences . 

3. Rule violators (3) 
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High Cos t Projects (Over $1,000,000) ; (3) 

I. Generalized projects at the high school cr ^i llege 
levels. 

!• Including eval'jation plus either training, dissemination 
surveys/conf erences , or combinations thereof 

Category D; Subject Matter-Total Curriculum ; (2) 

Lost Cost ($250,000) i (1) 

1. Projeccs including the development of testing or 

measuring techniques which are targeted toward one or 
a few schools or only a specific application, and which 
include evaluation and trai*iing 

High Cos t ($5,32 5 ,000); ( 1 ) 

1. TV for preschoolers, directed toward general application. 

Category E; Classroom Operations : (12) 

$10,000 - $100,000 Cost Grou p; (7) 

1. (Generalized projects, some i^ich include ronputer 
systems (CTA) or application o^ mulcim6<]ia techniques. 

2. In all cases; Mo training, or major HI ssemi nation efforts 

$100,000 - $140^000 Cost Group ; (3) 

1. Generalized projects, some which include films and 
classroom simulations. 

2. Ln all cases; Projects include either training or 
dissemination activities. 

$200.000 - $300,000 Cost Group ; (2) 

1. Projects including the development of both computer 
systems and testing/measuring instruments. 

Category F; Subject Matter Plus Classroom Operations - 
Single Course : (/4> 

Low Cost ($84,000) ; (1) 

1. Projects which include the development of films and 
audio presentations, plus evaluation and training. 

Medium Cost ($645,000) ; (1) 

1. Projects of a multimedia emphasis, which Include 

evaluation and which are targeted toward a specific 
application 
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High Cost (Approximately $1>250.00Q) ; (2) 

1. Projects of a multimedia emphaslfi which Include 
development of a computer system and project 
evaluation, and which are targeted toward a specific 
application. 

Category G; Subject Matter Plus Classroom Operations - Single 
Field ; (23) plus 2 rule violators of low cost. 

$200^000 - $800,000 Cost Group ; (21) 

1. Projects at any education level and In any field. 

2. Most Include evaluations, and some Include training, 
dissemination, or surveys/conferences. 

3. In all cases; No computer systems or multic^dla 
project development. 

High Cost (Approximately $2,000,000) ; (2) 

1. Generalized projects which include computer 

systems and the development of tests or measures, plus 
evaluation , 

or 2. Multimedia projects which Include evaluation, training, 
dissemination, and surveys /ecnferencee. 

Category H; Subject Matter Plus Classroom Operations - Total 
Curriculum : (2A) 

$20,000 ■ $70,000 Cost Group ; (20) 

1. In all cases, projects are targeted for single school 
districts, and at the high school level, with one 
exception at the elementary level; moat projects 
include evaluation, some include training. 

2. In all cases; No dissemination activity and no test/ 
measure development. 

$300,000 - $350.000 Cost Grc^p ; (3) 

1. Projects which include either targeted test /measure 
development > or development of a Ph.D program, or which 

also focus on administrative procedures for school 
management . 

2. In all cas^s; No training, dissemlaation, or surveys/ 
conferences. 

High Cost ($1,165.000) ; (1) 

1. Development of a 2 year college program, with associated 
^ evaluation and survey/conft^rence activity. 

ERIC 
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Category Is Administrative Techniques/Procedures - With 
Computer Systems ; (9) 

Under $1>000>00Q Cost Group ; (6) 

1. Projects with evaluation, training, or dissemination 

Over $1,000.000 Cost Group ; (3) 

1. Projects which also Include development of subject 
matter for a course of Instruction, plus evaluation. 

or 2. Projects which Include TV dlspl^s associated with the 
computer system, and evaluation plus dissemination 

or 3* Projects which Include all of; Training, dlssemlnlatlon 
aid survey/conferences 

Category J; Administrative Techniques/Procedures Without 
Computer Systems : (23) 

Predominantly undlf ferentlable projects between $20,000 
and $500,00. However, projects which are generalized, and 
which Include the development of tests/iueasures with accompanying 
manuals /guides, cluster between $100,000 md $150,000 



All but two proJect(» liaclude develo^tent of manuals /gtiidea. 
Some include evaluations, but only one includes training* 
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flgure 5. 



FLOW CHART FOR COSTING DEVELOPMENT PROJECTS (139) 



ERIC 



-pa 



( DEVELOPMENT CATEGORY? ) 



SUBJECT MATTER - MATERIALS ) ►tO (T) (16) 

SUBJECT M.VTTER - SINGLE COURS ^ ^ TO (6) 

SUBJECT MATTER - SINGLE FIELD^ ^ TO (c^ (18) 

SUBJECT MATTER - TOTAL CURRICULUM ) ^ TO (l^ (2) 



CLASSROOM operation's^ ^ TO (e) (12) 



SUBJ. MATTER PLUS CL. OPS. - SINGLE COURSE > ^ TO (A) 



SUB J. MATTER PLUS CL. OPS. - SINGLE FIELdI ^ TO (T) (25) 



SUBJ. MATTER PLUS CL. OPS. - TOTAL CURRIC. ) ^ TO (24) 

ADM INISTRATIVE TECHS/PRQC- WITH COMPUTER ) ^ TO ^T^ (9) 

ro (j) (23) 



ADMINISTRATIVE TECHS /PROC. - WITHOUT COMPUTER 



BEST COPY AVAiLAtili 

- 30- 



igirf (com.) 




: SUBJECT MATTER - ::.Vj i'RlAl.S iii\'LV 



YES 



'K 'kf)OK.VV J 



Ctexthook? ) 

YES: 550 ( 



NO 



NO 



il^iS .\ND AUDIO 



\ 0' l^XTfiOOK 

^ — I 



\^:\ v: L Af ! JN < 'R iRA ; . . j 



YES: ^UO->!ly (J) 293 



r ' GCWrS-TzED; with Tm"i^OOK . A ^ 
V WORKBOOK. OR MANU ALS /'-:UDE>. " J ^ 



Av. 



J 



T 

NOl^ '-►vKS. 100-200 <4) 172 W. 



10-100 (8) 29 Av. 




Number in () ■ aunfcer of projects which fell into that rost group t<r 
category. Cost groups stated in thousands of dollars. Rule violators 
are not represented. 
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figure 5. (cont.) 



© = 



SUBJECT MATTER - SINGLE FIELD 



C 



AT LEAST 2 OF THE FOLLOWING: EVALUATION 
TRAINING . SURVEYS / CONFERENCES ? 



NO 



3 



YES: OVER 1 M (3) 2,266 Av. 



/ GENERALIZED; MANUALS /GUIDES PLUS EITHER EVALUAXION \ 
V SURVEYS /CONFERENCES. OR FILMS AND AUDIO ) 



NO 



YES: 200-250 (4 ) 235 Av. 



( EVALUATION OR SURVEYS /CONFERENCES? ) 



NO l**-^ YES: 100-200 (5) 150 Av. 
60-100 (3) 86 Av. 



© 



SUBJECT MATTER - TOTAL CURRICULUM (2) 



© 



c 



DEVELOPMENT OF TESTING OR 
MEASURING TECHNIQUE 

L>256 

CLASSROOM OPERATIONS (12) 



X 



TV FOR PRE- 
SCHOOLERS 

L^5,325 



c 



COMPUTER SYSTEM PLUS 
TEST/MEASURES? 



NO 



YES: 200-300 (2) 258 Av. 



c 



AT LEAST 2 OF THE FOLLOWING: EVA2-UATI0N, 
TRAINING, DISSEMINATION^ SURVEY S /CONFERENCES < 



NO 



▼ 

10-80 (7) 38 Av. 



YES: 100-140 (3) 117 Av. 



Nunfcer In () - nunber of projects which fell into that ccn^t group or 
category. Cost groups stated in thoxxsands of dollars. Ruie violators 
are not represented. 
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flgure 5. (cont.) 



© 



SUBJECT MATTER PLUS CLASSROOM OPERATIONS - SINGLE COURSE (4) 



( 



MULTIMEDIA 
EMPHASIS 



)IA \ 



^YES 

( PLUS COMPUTER SYSTEM/PROGRAMS? ) 



YES: OVER 1 M (2) 1,248 Av. 



NO NO I — ^ 

(1) 84 (1) 643 

: SUBJECT MATTER PLUS CLASSROOM OPERATIONS - SINGLE FIELD (25) 

c 



COMPUTER SYSTEM/PROGRAMS OR ALL OF 
THE FOLLOWING: EVALUATION, TRAIN1.^(;, 
DISSEMINATION , AN D SLUVEYS/ CONFERENCES 



No"^|^ L-^ YES; APPROXIMATELY 2 M (2) 1,990 Av. 

200-800 (21) 471 Av. 



^H^ : SUBJECT MATTER PLUS CLASSROOM OPERATIONS - TOTAL CURRICULUM (24) 

/ 2 YEAR COLLEGE PROGRAM WITH EVALUATION V 
AND S URVEYS / CONFERENCE S? / 

NO^ IZ^YES: APPROXIMATELY I M (I) 1,165 Av. 



/ TARGETED; HIGH SCHOOL LEVEL; \ 
V NO TEST /ME ASURE DEVELO PMENT J 

NO^ I— ^YES: 20-70 (19) 52 Av. 
300-350 (3) 327 Av. 



Number In () « number of projects which fell into that cost group or 
category. Cost groups stated in thousands of dollars (or M « millions 
of dollars). Rule violators are not represented. 
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flgure 5. (cont.) 



© 



ADMINISTRATIVE TECHNIQUES/PROCEDURES - WITH COMPUTER SYSTEMS (9) 



© 



/ WITH ADDITIONAL N 
\ COURSE DEVELOPMENT? J 

L>YES: 1 M-2 M (1) 1.803 Av. 



( 



WITH DISSEMINATION PLUS EITHER 
TRAINING OR SURVEYS/CONFERENCES? 



NO 



YES: 1 M ^ 2M (2) 1,377 Av. 



tinder 1 M (6) 340 Av. 



ADMINISTRATIVE TECHNIQUES /PROCEDURES - WITHOUT COMPUTER SYSTEMS (23) 



C 



DEVELOPMENT OF GENERALIZED TESTS/ 
MEASURES PLUS MANUALS/GUIDES? 



YES: 100-150 (4) 117 Av. 



.L ELSE 20-500 (19) 153 Av. 



Nuiii>er In () « number of projects which fell Into that cost group or 
catei^ory. Cost groups stated in thousands of dollars (or M « Trillions 
of dollars). Rule violators are not. represented. 
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VI > TRAINING PROGRAMS IN EDUCATIONAL RESEARCH 
Descriptive Characteristics; 

1. Ph,D, Program , A training program which itself leads toward the 
doctoral degree, rather than a program supplement to existing 
degree programs in other fields. 

2. Masters Program . Same as above except leading to the masters 
degree. 

3. Postdoctoral Fellowship Program . Support for a single participant 
in an intensive program of educational research. 

4. Field/Target Specific. A training program directed toward either 
a specified field of educational research, a specified area of 
competency or position, or a specified geographical or institutional 
market. 

5. Consortium Program . A training program involving the participation 
of more than one university, or cosponsored by a number of school 
districts or other educational institutions. 

6. Field Link With District . A training program in which strong ties 
with specified school districts are utilized for internships and 
obtaining field experience. 

7. Proposed Institutes . Training workshops or seminars under the overall 
direction of a proposed institute. 

8. Preconference Training Sessions . Training sessions conducted prior 
to and in association with a major educational conference. 

9. Small Scale . Degree or nondegree programs of at least two years in 
which the number of participants is between 6 and 34. 

10.. Large Scale . Degree or nondegree programs of at least two years in 
which the number of participants is between 40 and 60. 



Cost Groups: 

A. $10,000 - $50,000 Cost Group : (44) 

1# Postdoctoral fellowship programs. (33) 

2m Three day to seven week long meetings involving 30 to 240 
participants (9) 

a) usually field or target specific 

b) sometimes held as preconference training sessions 



TRAINING PROGRAMS IN EDUCATIONAL RESEARCH 



3. SmaJl scale, nondegree programs of a nonconsortium 
nature lasting one year or less. (2) 

B. $50,00 - $100,000 Cost Group ; (4) 

1. Consortium training programs, nondegree. (2) 

2. Rule violators (2) 

C. $100.000 - $500,000 Cost Group ; (63) 

1. Small scale, degree or nondegree programs, which are 
field/target specific (8-34 participants) (40) 

2. Other small scale, degree or nondegree programs, which 
are not field/target specific (6-30 participants) (18) 

3. Rule violators (5) 

D. Over $500>000 Cost Group ; (4) 

1. Large scale, degree or nondegree programs (40-60 
participants) (4) 
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flgure 6. 



FLOW CHAKT FOR COSTING TRAINING PROGRAMS 
IN EDUCATIONAL RESEARCH (115) 



r 

V 



LARGE SCALE PROGRAMS (40-60) 
PARTICIPANTS AND AT LEAST 1 
EAR? 



NO 



YES: 600-1400 (4) 859 Av. 



/small scale programs (6-34) 
(participants and at least 1 
Vear? 



NO. 



) 



YES: 100-500 (58) 272 Av. 



[CONSOKTIUM TRAINING PROGRAMsT) 



NO 



YES: 50-60 (2) 55 Av. 



PELLOWShfPS AND SHORT PROGRAMS^ 
(1 YEAR OR LESS) 



10-50 (44) 22 Av. 



Number in () = number of projects which fell into that cost group or 
category. Cost groups stated in thousands of dollars. Rule violators 
are not represented. 
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VII, CONFERENCES > WORKSHOPS > SYMPOSIUMS. AND SEMINARS 



(A) Descriptive Characteristics: 

1. Writers of backgromid papers * Indicates thaii: content for 
thr:, meeting has been prepared in advance by specified 
writers . 

2. Analysis or actual plan development by attendees . Separates 
those meetings in which attendees listen and discuss, and 
those meetings during which attendees are expectad to produce 
a plan or analysis related to the meeting topic. 

3. Di r gemination of results . Indicates a stated intent to 
piiblish or otherwise disseminate proceedings or results 
of the meetings. 

(B) Cost Groups: 

1. $12,000 - $40>000 Cost Group : (6) 

Seminars and symposiums. (5) 
Rule violators (1) 

2. $40,000 - $70,000 Cost Group : (8) 

National conferences or workshops without expected production 
of coherent plan or analysis by attendees. 

3. $125,000 Cost Group : (1) 

Working Conferences in which attendees are expected to produce 
a development plan, and for which 30 background papers are 
written. 



ERLC 
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figure 7. 



FLOW CHART FOR COSTING CONFERENCES, WORKSHOPS, 
SYMPOSIUMS, AND SEMINARS (15) 



TYPE PROJECT? 



SEMINARS OR 
SYMPSOIUMS 



NATIONAL CONFERENCES 
OR WORKSHIPS 



15-40 (5) 26 Av. 



WORKING 
CONFERENCES 



40-70 (8) 51 Av. 



125 (1) 



Number in () - nunber of projects which fell into that cost group or 
category. Cost groups stated in thousands of dollars. Rule violators 
are not represented. 
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Vlil, R&D CENTERS AND REGIONAL LABS 

This section on R&D centers and laboratories represents a different 
cut through the f\jnding of R&D by looking at past allocations of support 
to entire non-university Instututions which then have discretionary powers 
as to which individual projects will be funded and adiflinistered. Unlike 
the other sections in this report which describe surveys, studies, and 
training programs ia terns of their inherent cost-driving properties such 
as scale and specific activity, this section contains nothing which 
identifies characteristics which directly drive costs to specific levels. 
Rather, the analysis describes the relative amounts of funding which the 
Office of Education has itself decided to allocate to these institutiotis. 
Future decisions may show a different attitude in the fuading of institu- 
tions such as centers and labs, for example, by providing less discretionary 
funding and encouraging more use of directly funded individual projects. 

Costs of center or lab operation are listed in annual terms (full 
project cost divided by number of years of funding) in order to provide a 
more familiar basis to those administrators who deal with these operations. 
Again, I emphasize that these cost figures represent only past attitudes 
toward non-university institutional funding of R&D , There is nothing 
causal intended. 

(A) Descriptive Characteristics: 

1. ERIC Center . Establishing or continuing an educational 
resources information ceniiter. 

2. Regional Lab . Establishing or continuing a major regional 
laboratory . 

3. Preliminary Study . Indicates that the scope of the project 
covers only the planning or testing studies prior to the 
establishment of a proposed center or lab. 

4. Center Operation . Indicates that the project includes the 
initial or continuing operation of center or lab for 1 to 5 
years . 

5. Studies, Plans . Major focus on studies or planning activity. 

6 . Development of Instructional Materials . Compone"2)t focus . 

7 . Development of Theories of Instruction or Learning . Component 
focus « 

8. T eaching, Research, or Administrative Training . Component focus. 
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9. Student Training , Center activity In early child , student ^ or 
adult education. 

10. Evaluation . Component focus. 

11. Dissemination and Demons t rat ion > Component focus. 

12. Testing Programs , Focus on laboratory or field testing of 
center programs. 

13. Management > Organization of Schools > Indicates a focus on the 
administrative and institutional arrangements of schools and 
districts. 

14. Computer Assisted Instruction (CAI) , Component focus. 
15^ T.V. Instruction . Component focus, 

16. Computer Facility * Indicates a proposed system for providing 
computer services to the regional educational community. 

17. Mass Media . Indicates center activity involving utilization 
of public broadcasting or other public media. 

18. Pro d uction Capacity . Indicates proposed center capability for 
produciii^ ZT'terlalSy displays » games » and other educational tools 
and productf>. ' 

Cost Groups: 

A. $30^000 - $130>000 Annuel Cost Group ; (17) plus 1 rule violater 

1. ERIC centers focused on minor educational areas such as 
testing and measurement » foreign languages , and library 
sciences. ($44,000 - $130,000) (5) 

2. Preliminary studies and center operations (12) which include: 

a. no development of materials 

b. no development of theories of learning or instruction 

c. no major evaluation 

d. no focus on the management or organization of shcools 

e. no CAI. TV Instruction, or production capabilities 

B. $130,000 - $260.000 Annual Cost Croup ; (15) plus 1 rule violator 

ERIC caters focused on major educational areas such as 
higher education, vocational education, teacher education, 
educational technology. English, reading, and junior colleges. 
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C, $400,000 - $1,A00,000 Annual Cost Group : (28) 

1. Labs for regional areas of minor population concentration 
such as South*Central, Kichigan-Ohio, Southeastern, and 
Appalachian. ($87,000 - $1,153,000). (13) 

2, Preliminary studies or center operations (11) which do include 
either: 

a. development of materials 

b. development of theories of learning or instruction 

c. major evaluations 

d. focus on the management or organization of schools 

e. CAI, TV, or production capabilities 

• 3. Rule violators (4). 

D. $1,500,000 - $3,000,000 Annual Cost Group : (9) 

1, Labs for regional areas of major population concentration such 
as Fat West, Central -Midwestern, and Metropolitan New Yoik, 
and which may include activity in CAI, provision of computer 
facilities to its region, and production capabilities. (7) 

2. Center operations which include development of theories or 
computer services, and which focus on very general educational 
areas, such as learning or vocational education. (2) 



I 
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FLOW CHART FOR COSTING R&D 
CENTERS AND REGIONAL LABS (71) 



CKEGIONAL L^ 



NO 



(FOR MAJOR POPULATION CENTERj 



NO L_» 1.5M-3M ANNUAL COST (7) 2, 107 Av. 
^R MINOR POPULATION CENTERl 



L> .5M-l' 



2M ANNUAL COST (13) 804 Av. 



(ERIC CENTER?^ 



NO 



YES 



FOCUSED ON HAJOR EDUCATIONAL 
AREAg OF INTEREST 



NO 



130-: 



260 ANNUAL COST (15) 191 Av. 



FOCUSED ON MINOR EDUCATIONAL 
AREAS OF INTEREST 



[Nj:ERES 



44-130 ANNUAL COST (5) 79 Av. 



EMPHASIZING DEVELOPMENT OF THEORIES OR PROVIDING COMPUTER 
SERVICES, AND FOCUSED ON VERY GENERAL EDUCATIONAL AREAS; 
E.G.. LEARNING OR VOCATIONAL EDUCATION 



NO 



YES: 2M-2.5M ANNUAL COST (2) 2,302 Av, 



INCLUDING EITHER DEVELOPMENT OF MATERIALS, DEVELOPMENT OF 
FHEORIES, EVALUATION, FOCUS ON MANAGEMENT, TV, CAI, OR 
PRODUCTION CAPABILITY 



NO 



YES: .4M-1.4M ANNUAL COST (11) 1,126 Av. 
30-130 ANNUAL COST (13) 83 Av. 



Number in () = nunijer of projects which fell into that cost group or 
category. Cost groups stated in thousands of dollars (or M = millions 
of dollars). Rule violators are not represented. 

ERIC 
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IX, PROGRAM OF FUNCTION FACILITATION 



These projects serve to Intprove, expand, develop, or help institute change 
in existing educational programs or operations. They either provide supple- 
iDentary progran activity, or facilitate ongoing educational functions such 
as teaching, progran leadership, or evaluation. 

Sone aid in the training of personnel for these programs or functions through 
short* term institutes, workshops, seminars, forums, or conferences related to 
the programs. Others facilitate program liq>lementation through program planning 
projects, demonstration or dissemination projects, or by establishing consortiums 
of. colleges or universities for their mutiiAal development of research capability. 
Finally, some projects facilitate program Or function development by providing 
funds for facility expansion . 

(A) Descriptive Characteristics: 

1. Traininf^ Institute/Program . Short-term (5 days - i weeks) or 
longer term (6 weeks « 2 years) training programs related to 
teaching, evaluation, administrative or innovative leadership. 
These programs may be in the form of institutes, workshops, con- 
ferences, forums, or seminars. 

2, Multiple * Institutes . A project which includes the operation of 
more than one training institute. 

3, Program Planning/Coordinating . A project whose main focus is the 
planning of, or coordinating of, a specific program or a specific 
educational function such as evaluation or dissemination of research 
information. 

4. Demonstration/Dissemination . A project whose main focus is aiding 
in the implementation of an existing program by providing supple- 
mentary demonstration or dissemiination activity. 

5, Facility Expansion . Added staff, equipment, or space to any program, 
educational institution, or service activity. 

6. Consortiums . Coordinated efforts among a number of colleges or 
universities toward either research development or teacher training. 
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Cost Groups: 

A. $10.000 - $50,000 Cost Group ; (36) 

1. Short term C3 days - 3 weeks) training Institutes/programs. (16) 

2. Program planning/ coordinating projects* excluding large 
major planning efforts. (12) 

3. Small staff increments (1-2) for facility expansion. (3) 

4. In all cases: no consortium activity, space or equipment 
expansion, demonstration or dissemination projects, or 
multiple institutes. 

5. Rule violators (5) 

B. $50,000 $100.000 Cost Croup ; (11) 

1. Longer term (6 weeks - 2 years) training institutes /programs. (4) 

2. Larger or longer planning/coordinating efforts. (1-2 years 
of about 10 mctt) (7) 

C. $100,000 - $200,000 Cost Group; (25) 

1. Consortiums of from 3-6 colleges or universities for 
research development (8) 

2. Consortiums for teach training. (4) 

3. Demonstration/dissemination projects. (6) 

4. Facility expansion through additions of staff and/or 
equipment, but not space. (5) 

5. Rule violators (1) 

D. $200.000 - $500.000 Cost Croup : (8) 

1. Multiple training or planning institutes. (3) 

2. Large consortium projects of approximately 20 colleges or 
universities for research development* (1) 

3. Long term (2-3 years). (2) 

4. Rule violators (2) 

E. Over $500.000 Cost Group : (3) 



1. Major facility expansion through added space and equipment. (3) 
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FLOW CHART FOR COSTING PROGRAM OR 
FUNCTION FACILITATION PROJECTS (83) 



ERIC . 



FACILITY EXPANSION? ) (14) 



NO 



YES 



( SPACE AND EQUIPMENT? ) 



NO 



CONSORTIUM PROJECTS FOR 
RESEARCH DEVELOPMENT? J (9) 



NO 



3 



YES: OVER 500 (3) 2,254 Av. 



( 1 or 2 STAFF ONLY?"^ 



YES 



NO 



( OF ABOUT 20 COLLEGES? ) 

L^YES: 212 (1) 



YES: 13-23 (3) 20 Av. 



NO 



YES: 100-180 (5)134 Av. 



( OF 3 - 6 colleges"?") 

I — ^YES: 90-140 (8) 121 Av. 



c 



CONSORTIUM PROJECTS FOR 
TEACHER/EVALUATOR TRAINING? 



(4) 



L^YES: 125-185 (4)159 Av. 
C TRAINING INSTITUTES ) (28) 



NO 



YES 



-► ( MULTIPLE INSTITUTES ) 

^NO L^YES : 230-390 (.3) 323 Av. 
( LONG TERM (6 WEEKS-2YEARS)? ) 

1 

Xno I— ^YES: 55-100 (4) 71 Av. 
( SHORT TERM (5 DAYS-3WEEKS) ? ) 

I ► YES : 10-50 (16) 26 Av. 
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flgure 9 (cont.) 



PROGRAM PLANNING 
OR COORDINATION 



NO 



(21) 



YES 



^LONG TERM (2-3 YEAR) EFFORTS?) 



NO 



YES: 311-425 (2) 368 Av. 



(MEDIUM SIZE (1-2 YEARS. 9 MEN) EFFORTS?} 



NO 



YES: 65-90 (7) 76 Av. 



feMALL SIZE (1 WEEK-1 YEAR) EFFOCT?) 

YES: 10-50 (12) 31 Av. 



U 



DEMONSTRATION OR 
DISSEMINATION 
PROJECTS 



T 



(7) 



100-200 (6) 132 Av. 



Number in () - number of projects which fell into that cost group or 
category. Cost groups stated in thousands of dollars. Rule violators 
are not represented. 

ERIC 
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X. RESIDUAL CATEGORIES 

The remaining projects fall Into three residual categories. 

1. Miscellaneous Projects Which Cost $10,000 or Less . 

Of this set of residual projects, most are one year support 



for simple studies. The complete breakdown is: 

a. Theoretical, analytical, or experimental studies 288 

b. Surveys 8 

c. Development projects 80 

d. Product or program evaluations 28 

e. Research training programs 3 

f. Conferences, workshops, or seminars 5 

g. Centers or regional labs _ 0 

h. Program or function facilitation projects 5 
Total miscellaneous projects costing $10,000 or less: 417 

2. Miscellaneous Projects for Which No Cost Figure is Indicated 

a. Theoretical, analytical, or experimental, studies 42 

b. Surveys 2 

c. Development projects 27 

d. Product or program evaluations 1 

e. Research training programs 8 

f. Conferences, workshops, or seminars. 0 

g. Centers or regional labs 0 

h. Program of function facilitation projects 3 
Total miscellaneous projects for which no cost is given: 83 



Uncategorized Projects , These 57 miscellaneous projects are 
subject to any of the following situations: 

a. The title and paragraph description are sufficiently 
vague to prohibit categorization , 

b. The objective is sufficiently different from those 
eight categories outlined above to prohibit its placement 
in any one of them 

c. The paragraph description is not sufficiently informative 
to provide meaningful rationale as t o why the project 
costs what it does, , , 



Project descriptions of these natures usually emphasize the 
necessity, desirability, and importance of the project or 
its resulting contributions, and in doing so, provide too little 
indication of the kind and scope of activities which will actually 
be carried out. 
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XI, . NSF FUNDED EDUCATIONAL PROJECTS 

Principal Curriculum Study Groups 

In describing the Course Content Improvement Program of the 
Division of Pre-College Education in Science, NSF separates out twenty- 
six projects wh^ch it calls Principal Curriculum Study Groups. These 
are all curriculum development programs with the following descriptive 
character is t ics ; 

1. They are directed toward mathematics, science, or both. 

2. They cover the total field rather than a single course or 
materials only. 

3. They cover a grade span of two years or more (up to 13 years).. 

4. All projects invlove some evaluation, -teacher-training,„ and 

dissemination activites. 

5. All are generalized projects, to be use for wide application. 
Unlike the projects funded by the Office of Education for development of 
curricula for a total field, these projects generally involve larger 
scope in grade span and larger dollar committments. This is shown ^.n 
the following figure which compares the dollar distribution of curriculum 
development projects for a total field between Office of Education funded 
projects and NSF funded projects. 

Because the Office of Education data base of this report contains 
only two" relevant pro jects-above one^million -dollars- in- cost , the twenty^~ ~ 
six NSF Principal Curriculum Study Groups projects were not subjected 
to the cost rules developed on the basis of the Office of Education data . 
Instead, new cost rules are developed using this new data base. Cost , 
groups for these NSF curriculum development projects are listed below: 

Cost Groups: 

Under $1^000,000 Cost Group ; (6) 

1. Development of films; but not of texts (3) 

2. Development of texts; and grade span of only 2 years (2) 

3. Rule violators (1) 

$1,000,000 to $2,000,000 Cost Group ; (6) 

Development of texts; grade span average of 3. years (6) 

ERIC 
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figure 10. 

Con5)arison of the Dollar Distribution of 
Curriculum Development Projects for a Total Field 
Between Office of Education Funded Projecta 
and NSF Funded "Principal Curriculum Study Group" Projects 
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$2,000,000 to $5,000^000 Cost Gro up : ( 8) 

Texts; grade span a%7erage of 4.75 years (8) 

$5,000,000 to $10,000,000 Cost Group ; (4) 

1. Texts; grade span average of 5 years (3) 

2. Rule violators (1) 

Over $10^000,000 Cost Group ; (2) 

Texts; grade span average of 10 years (2) 



figure 11. 



FLOW CHART FOR 
COSTING NSF FUNDED 
"PRINCIPAL CURRICULUM STUDY GROUP" PROJECTS* (26) 



(dollars in Billions) 
( MAJOR EMPHASIS? ) 



FILMS AND 
NO TEXTS 



YES: .4-1 (3) .63 Av. 



* All projects are: 

1) Curriculum Development 

2) Cover a total field 

3) Involve sotDe evaulaticn» 
teacher trainings and 
dissemination activities 

4) Are generalized for 
wide application 



TEXTS AND 

SUPPLEMENTARY 

MATERIALS 









NO 



NO 



NO 



NO 



( 



GRADE SPAN OF 
2 YEARS? 



) 



YES: .5-1 (2) .8 Av. 



GRADE SPAN OF 
ABOirr 3 YEARS 



L4 YES: 1-2 (6) 1.4 Av. 



( 



GRADE SPAN OF 
4 AND 3M YEARS? 



YES: 2-5 (8) 3.2 Xv. 



c 



GRADE SPAN OF 
ABOUT 5 YEARS 



^YES: 5-10 



(3) 5.3 Av. 



c 



CUDiE SPAN OF 
ABOUT 10 YEARS 



Number in () • nunter of projects vhlch fell into 
that cost group or category. Coat groups stated 
la millions of dollars* Rule violators are not represented. 



^ YES: OVER 10 (2) 
(lO.^. 14.8) 
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Cogq)arable WSF Educational Projects Subjected to the Cost Rules 

A saiople of NSF educational projects described In the saiae 
brief paragraph (format as those of the Office of Education projects 
was subjected to the coat rules of this report developed strictly on 
the O.E. diata base. The sample Is frots projects of the Course Content 
Inprovenierit Program (pre-college) Initiated In FY 1971, and projects 
of the Science Curriculum Improvement Program (undergraduate) initiated 
In FY 1969. This set does '^ot overlap with the former twenty-six 
Principal Curriculum Study ^up** 

Overall Results: 



A total of twenty-ei^t NSF educational projects were subjected 

to cost ruled developed on the basis of Office of Education 

project data. Tbe overall reatilts are: 

17 NSF educational projects conformed to the 
Office of Education developed cost rules 

7 NSF educational projects violated the Office of 
education developed cost rules (of these seven, 
four were of higher cost than predicted by the 
cost rules and three were of lower cost) 

4 NSF educational projects were of a new kind and 
neither conformed to nor violated the cost rules 

The breakdown of these results Into component R&D project areas 
follows: 

A) THEORETICAL, ANALYTICAL, AND EXPERIMKriAL STUDIES: 
2 NSF rule violators (both of higher cost) 

1 rule conformer 

total of 3 NSF educational projects 

B) SURVEYS: 

I rule violator (of hl^er cost) 

total of 1 NSF educational projects 
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PROCRAM OF PRODUCT EVALUATIONS: 
1 NSF rule ccnfonner 

total of 1 NSF educational project 
DEVELOPMENT PROJECTS: 

3 NSF rule violators (2 of lower cost, 1 of higher cost) 
14 NSF rule confonners 

total of 17 NSF educational projects 
CONFERENCES, WORKSHOPS, SYMP0S1U>C, AND SEMINARS: 
3 NSF projects of a new kind (neither rule confonners 
no violators) 

total of 3 NSF educational projects 
PROGRAM OF FUNCTION FACILITATION PROJECTS: 
1 NSF rule violator (of lower cost) 
1 NSF rule conformer 

1 NSF project of a new kind (belther conformer nor violat 
total of 3 NSF educational projects 
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APPENDIX 
FORMATS OF THE DATA MATRICES 
FOR EACH RU) CATEGORY 
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SYMPOSIUMS, AND SEMINARS 
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